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Abstract 


This  brief  report  documents  the  collection  of  supplemental  data  to  augment  the  second  phase  of  a 
research  effort  to  develop  an  early  warning  model  for  monitoring  state  instability  and  predicting 
pending  failure.  This  complemented  and  extended  earlier  efforts  to  develop  a  conceptual  model 
and  to  characterize  triggers,  the  final  events  recorded  between  non-violence  and  violence  (relative 
stability  and  instability).  Given  the  experimental  nature  of  the  research,  more  data  are  required  to 
provide  a  greater  breadth  of  analysis.  A  more  diverse  data  set,  in  term  of  regional  representation, 
the  magnitude  of  violence,  the  magnitude  of  instability,  would  provide  a  more  nuanced  result. 
This  document  summarizes  the  supplementary  data  collection  to  support  this  effort. 


Resume 


Le  present  rapport  sommaire  fait  etat  des  donnees  recueillies  pour  completer  celles  ayant  ete 
amassees  durant  la  deuxieme  phase  d’un  projet  de  recherche  visant  a  elaborer  un  modele  de 
pre-alerte  servant  a  surveiller  Tinstabilite  des  etats  et  a  prevoir  leur  mise  en  deroute.  Ce  travail 
vient  completer  les  efforts  precedemment  deployes  pour  mettre  au  point  un  modele  conceptuel  et 
pour  caracteriser  les  elements  declencheurs,  soit  les  demiers  incidents  enregistres  avant  le 
passage  de  l’etat  de  tranquillite  au  desordre  (ou  de  la  stabilite  relative  a  Tinstabilite).  Vu  la  nature 
experimental  de  la  recherche,  davantage  de  donnees  devront  etre  recueillies  afm  d’elargir  la 
portee  de  Tanalyse.  En  disposant  d’un  ensemble  de  donnees  plus  diversifies  sur  le  plan  de  la 
representativite  regionale  et  du  degre  de  violence  et  d’instabilite,  on  obtiendrait  des  resultats  plus 
nuances.  Le  present  document  offre  un  resume  des  donnees  complementaires  recueillies  pour 
mener  a  bien  ce  travail. 
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Executive  Summary 


Indicators  of  State  Failure:  Phase  III 

Jordan  Miller;  DRDC  Toronto  CR  2010-180;  Defence  R&D  Canada  -  Toronto. 


As  noted  in  the  Canada  First  Defence  Strategy  and  reiterated  in  the  more  recent  US  Quarterly 
Defence  Review,  instability  and  state  failure  in  distant  lands  can  directly  affect  our  own  security 
and  that  of  our  allies.  Development  of  a  predictive  model  has  become  both  a  topical  issue  and  an 
increasingly  important  area  of  research  in  academic  and  policy  communities.  This  is  the  third 
report  documenting  CAE’s  support  to  DRDC’s  continuing  efforts  to  develop  an  Early  Warning 
Model  (EWM)  of  state  instability. 

The  conceptual  framework  for  an  EWM  was  developed  in  a  previous  project,  though  without  a 
data  set  to  validate  assumptions  and  the  general  hypothesis.  The  focus  of  the  current  project  was 
to  collect  and  code  events  data  and  integrate  it  with  structural  data  that  will  be  used  to  calibrate 
and  validate  the  conceptual  model.  This  formed  the  bulk  of  the  work  in  Phase  II  of  the  project. 
Phase  III  -  this  phase  -  was  supplemental  to  Phase  II,  its  purpose  was  to  collect  supplemental 
data  that  would  be  coded  and  analyzed  using  the  same  methodology  as  that  from  Phase  II.  A 
descriptive  framework  was  established  and  incidences  of  failure  identified  using  the  methodology 
developed  by  Carleton  University’s  Country  Indicators  for  Foreign  Policy  (CIFP)  project.  Events 
data  were  then  collected  for  the  24  months  preceding  these  instances  of  state  failure.  Periods  of 
relative  stability  for  these  states  were  also  identified  and  events  data  collected  for  these  periods. 
These  events  were  distinguished  as  eroding  or  bolstering  state  Authority,  Legitimacy  or  Capacity, 
including  the  severity  of  the  challenge  recorded. 

The  conceptual  model  envisages  integrating  events  and  structural  data  which  would  allow  for  the 
measurement  and  monitoring  of  state  tension  and,  through  regression  analysis,  for  vulnerability 
and  instability  thresholds  to  be  determined  and  crises  of  interest  to  be  forecast.  This  report 
documents  a  uniquely  extensive  data  base  that  has  been  developed  to  support  this  effort. 
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Sommaire 


Jordan  Miller;  RDDC  Toronto  CR  2010-190;  R  &  D  pour  la  defense  Canada  - 
Toronto. 

Comme  il  est  indique  dans  la  Strategic  de  defense  Le  Canada  d  ’abord,  et  plus  recemment  encore 
dans  l’examen  trimestriel  de  la  defense  des  Etats-Unis,  l’instabilite  et  la  deroute  d’un  etat  a  l’autre 
bout  du  monde  peuvent  nuire  directement  a  notre  propre  securite  et  a  celle  de  nos  allies.  Le 
developpement  d’un  modele  predictif  est  devenu  un  enjeu  d’actualite  et  un  sujet  de  recherche  de 
plus  en  plus  important  dans  le  milieu  de  l’enseignement  et  de  1’ elaboration  de  politiques.  Le 
present  rapport  est  le  troisieme  a  documenter  le  soutien  de  1’IAO  aux  efforts  constants  de  RDDC 
pour  le  developpement  d’un  modele  de  pre-alerte  (EWM)  d’instabilite  des  etats. 

Un  cadre  conceptuel  d’EWM  a  ete  elabore  dans  le  cadre  d’un  projet  anterieur  malgre  l’absence 
d’un  ensemble  de  donnees  permettant  de  valider  les  presomptions  et  l’hypothese  generate.  Le  but 
etait  d’amasser  et  de  coder  des  donnees  en  vue  de  leur  integration  a  des  donnees  structurelles  qui 
seront  utilisees  pour  etalonner  et  valider  le  cadre  conceptuel.  Voila  en  quoi  consistait 
principalement  la  phase  11  du  projet.  La  phase  III,  celle  qui  est  en  cours,  sert  de  complement  a  la 
phase  II :  elle  a  pour  but  de  recueillir  des  donnees  complementaires  qui  seront  codees  et  analysees 
en  employant  la  meme  methode  qu’a  la  phase  precedente.  Un  cadre  descriptif  a  ete  elabore,  et  des 
occurrences  de  deroute  ont  ete  cemees  au  moyen  de  la  methodologie  developpee  dans  le  cadre  du 
Projet  des  indicateurs-pays  pour  la  politique  etrangere  (CIFP)  de  l’Universite  Carleton.  Des 
donnees  d’evenements  ont  ete  recueillies  au  cours  des  24  mois  qui  ont  precede  ces  occurrences  de 
deroute  d’etats.  On  a  egalement  compile  des  donnees  d’incidents  observes  au  cours  de  periodes 
de  stability  relative  dans  ces  pays.  On  a  ensuite  classe  ces  incidents  selon  qu’ils  nuisaient  ou 
contribuaient  au  pouvoir,  a  la  legitimite  et  a  la  capacite  de  l’etat  en  question,  et  selon  leur  degre 
de  gravite. 

On  s’attend  a  ce  que  le  modele  conceptuel  serve  a  integrer  des  donnees  evenementielles  et 
structurelles,  permettant  ainsi  de  mesurer  et  de  surveiller  les  tensions  dans  les  etats.  De  plus,  au 
moyen  d’une  analyse  de  regression,  il  serait  possible  de  determiner  les  seuils  de  vulnerabilite  et 
d’instabilite,  et  de  prevoir  les  conflits  d’interets.  Le  present  rapport  decrit  une  base  de  donnees 
exhaustive  unique  conguc  pour  appuyer  ces  recherches. 
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1  Introduction 


1.1  Background 

The  Canada  First  Defence  Strategy  states  that  instability  and  state  failure  in  distant  lands 
can  directly  affect  our  own  security  and  that  of  our  allies.”1  Thus,  early  warning  analysis  has 
become  both  a  topical  issue  and  an  increasingly  important  area  of  research  in  academic  and 
policy  communities.  The  Canadian  government  has  recognized  the  need  for  predictive 
analysis,  and  DRDC’s  continuing  work  in  developing  a  conceptual  early  warning  model 
(EWM)  for  state  instability  reflects  this. 

This  vision  was  the  purpose  for  developing  the  research  methodology  and  analysis  framework 
to  determine  how  well  state  failure  could  be  predicted  from  data  focusing  specifically  on  the 
post  Cold  War  period.  This  report  provides  an  overview  of  the  supplemental  data  that  was 
collected  during  Phase  III,  supporting  the  initial  research  and  analysis  plan  from  Phase  II 
(Tikuisis  et  al.  2008). 

1.2  Objectives 

The  goal  of  Phase  II  was  to  support  development  of  EWM  for  monitoring  state  instability  and 
predicting  pending  failure.  The  purpose  of  this  phase  of  work  was  to  collect  and  code 
supplemental  events  data,  and  integrate  these  with  state  structural  data  for  eventual  calibration 
and  validation  of  the  conceptual  model.  Specifically,  the  project  involved: 

Model  definition, 

Identification  of  cases  of  state  failure  and  test  periods, 

Creation,  comparison  and  synthesis  of  structural  and  events  datasets, 

Econometric  analysis  of  events  data  and  specification  for  model  testing,  and 
Findings,  Conclusion,  and  Recommendations. 


The  Phase  II  report  ‘Indicators  of  State  Failure’  analyzed  events  data  for  the  purpose  of 
informing  a  Crisis  of  Interest  (COI)  model,  that  once  calibrated,  could  serve  as  an  EWM.  The 
work  done  in  Phase  2  was  a  continuation  of  the  research  on  triggers  of  state  failure  executed 
in  Phase  I  (Hales  and  Miller  2008).  This  document  summarizes  the  supplementary  data 
collection  that  was  performed  during  Phase  III.  As  data  collection  was  being  completed  to 
support  the  EWM  development  for  Phase  II,  the  scientific  authority  identified  regional  and 
severity  gaps  in  the  existing  COIs  that  were  selected.  Correspondingly,  additional  COIs  were 
added,  and  this  report  summarizes  that  collection  process. 


1  Canada  First  Defence  Strategy  -  Strategic  Environment,  http://www.forces.gc.ca/site/pri/first- 
premier/defstra/enviro-eng.asp 
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1.3  The  Team 


The  team  for  Phase  III  consisted  of  CAE  Professional  Services  (Canada)  Inc.,  the  Country 
Indicators  for  Foreign  Policy  (CIFP)  researchers  at  Carleton  University,  and  the  Scientific 
Authority  at  DRDC  Toronto.  This  team  worked  together  during  Phase  II  and  submitted  the 
final  report  collectively  (Tikuisis  et  al.  2008),  and  CAE  worked  with  DRDC  Toronto  on  the 
‘Triggers  of  State  Failure’  in  Phase  I  (Hales  and  Miller  2008). 
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2  The  Approach 


2.1  Introduction 

The  approach  to  collect  data  for  Phase  111  was  the  same  as  that  used  in  Phase  II  including  an 
inter-reliability  measures  to  check  human  coding  consistency.  The  methodology  used  to  code 
the  data  adopted  the  analytical  approach  developed  by  CIFP  (Carment  et  al.  2009),  referred  to 
as  ALC  that  distinguishes  three  dimensions  of  statehood:  Authority,  Legitimacy  and  Capacity. 
A  state  with  weak  Authority  is  unable  to  provide  a  secure  and  stable  environment  and  cannot, 
fully  enforce  its  laws.  Poor  Legitimacy  refers  to  lack  of  public  support  for  government 
decisions  and  policies.  Lastly,  a  state  is  weak  in  Capacity  when  it  cannot  mobilize  public 
resources  for  protective  and  productive  purposes. 

Incidents  are  also  evaluated  along  three  impact  dimensions  (causality,  escalation,  and 
centrality),  each  of  which  is  assessed  according  to  the  context  of  the  situation.  This 
methodology  allows  analysts  to  discriminate  between  the  effects  of  similar  events  in  different 
contexts.  In  addition,  this  study  made  use  of  structural  data  from  the  Political  Instability  Task 
Force  (PITF)  and  events  data  from  Virtual  Research  Associates  (VRA)  for  comparative 
purposes. 

2.2  Case  Selection 

An  important  consideration  for  case  selection  was  the  availability  of  data,  in  particular  13 
months  of  events  data  prior  to  and  including  the  month  in  which  state  failure  occurred  as 
defined  by  PITF  (2009).  These  occurrences  included  either  regime  change,  revolutionary 
war,  or  ethnic  war,  but  not  a  combination  of  these  to  minimize  confounding  factors. 

2.3  Data  Capture 

The  data  were  entered  into  a  dashboard  (see  Fig.  1)  in  Microsoft  Access  created  specifically 
for  this  project.  It  was  collected  using  LexisNexis,  an  open  source  newspaper/periodical 
database  to  search  for  daily  events  using  keywords  at  the  coder’s  discretion.  A  target  of  20  to 
25  randomly-selected  events  per  month  were  coded  according  to  the  CIFP  methodology,  as 
outlined  in  the  Phase  II  report.  All  the  collected  data  were  exportable  to  MS  Excel  for  later 
analysis.  Each  event  was  entered  into  the  dashboard  according  to  the  date  the  event  was 
reported,  the  headline  from  newspaper  or  magazine  reporting  the  event  or  a  paraphrase  of  the 
headline  (copyright  issue),  the  publication  the  reported  event  came  from,  the  score  (+  or  -)  for 
stabilizing  or  destabilizing,  respectively,  and  a  score  of  1  to  3  for  each  of  causality,  escalation 
and  centrality. 
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Figure  1:  Data  Entry’  Dashboard 


2.4  Cases 


The  cases,  listed  below  in  Table  1,  were  drawn  from  PITF  (2009)  and  characterized  as 
incidences  of  state  failure  owing  to  regime  change,  revolutionary  war,  or  ethnic  war. 

Table  1  Additional  Cases 


Country 

Period 

Country 

Period 

Algeria 

05/90-05/91 

Kenya 

10/90-10/91 

Armenia 

07/94  -  07/95 

Lesotho 

05/97  -  05/98 

Belarus 

04/94  -  04/95 

Mali 

06/89  -  06/90 

Cambodia 

07/96  -  07/97 

Nepal 

02/95  -  02/96 

Central  African  Republic 

03/02  -  03/03 

Niger 

01/95-01/96 

Comoros 

09/94  -  09/95 

Rwanda 

10/89-10/90 

Congo-Brazzaville 

04/96  -  06/97 

Senegal 

09/91  -09/92 

Congo-Kinshasa  (DRC) 

03/91  -03/92 

Sierra  Leone 

03/90-03/91 

Egypt 

02/91  -02/92 

Solomon  Isles 

06/99  -  06/00 

Ethiopia  (2  months) 

01/99-02/99 

Thailand  (1  month) 

07/03 

(The)  Gambia 

07/93  -  07/94 

Yemen 

04/93  -  04/94 

Haiti 

09/90-09/91 

Yugoslavia 

02/97  -  02/98 
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Ivory  Coast  (6  months) 

09/01  -  11/01 
07/02  -  09/02 

Zambia 

1 1/95  -  1 1/96 
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